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ALLOCATING NETWORK RESOURCES 
BACKGROUND 

This invention relates generally to allocating a network 
resource, such as bandwidth, to a data path. 
5 An MPLS (Multiprotocol Label Switching) network forwards 

data packets through data paths, called label^^sv^itched paths 
(LSPs), that are configured between source and destination 
devices. LSPs may experience different amounts of packet 
traffic load, thereby requiring different amounts of 
10 bandwidth . 

Traditional MPLS routers "blindly" configure LSPs on 
network paths that have the fewest number of hops. 
Consequently network congestion may result, even though there 
is available bandwidth on other network paths with greater 
15 numbers of hops . 

SUMMARY OF THE INVENTION 

In general, in one aspect, the invention is directed to 
allocating a network resource to a data path. This aspect of 
20 the invention features determining if a sufficient amount of 

the network resource is available in a network path to 

r' - . . 

accommodate the data path, and obtaining a cost associated 
with using the network resource available in the network path 
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for the data path. It is decided whether to allocate the 
network resource in the network path to the data path based on 
the amount of the network resource and the cost associated 
with using the network resource. One representative example 
5 of the data path is an LSP on an MPLS network. 

This aspect of the invention may include one or more of 
the following features. The network resource is bandwidth. 
Deciding whether to allocate the network resource includes 
comparing the cost to a predetermined maximum acceptable cost. 

10 The cost includes a number of hops on the network path between 
a source and a destination on the network. The number of hops 
is obtained by reference to a topology database for 
determining a path between the source and the destination. 
This aspect may also include allocating, to the data 

15 path, the network resource available in the network path if 
(i) the cost is at or below the predetermined maximum 
acceptable cost, and (ii) there is enough of the network 
resource available in the network path to accommodate the data 
path. If it is decided not to allocate the network resource 

20 available in the network path to the data path, determining, 
obtaining and deciding are repeated by substituting a network 
resource available to an Nth (N^2) network path for the 
network resource available to the network path. 
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Determining if enough of the network resource is 
available in the network path to accommodate the data path 
includes determining an amount of the network resource that^ i^s 
available on the network path but that is not used by existing 
data packets on the network path, and comparing an amount of 



the network resource needed by the data path to the amount of 
the network resource that is available on the network path but 
that is not used by the existing data packets. 

The data path has a predetermined priority level and 
deciding whether to allocate the network resource to the data 
path takes into account the predetermined priority level of 
the data path. At least a portion of the network resource in 

V, . • ~ ~ ' ~ 

the network path that is being used by a data path at a 
different priority level f rom_the jDrede termined_priority level 
is taken to' accommodate the data p ath at the predetermined 
priority level. The predetermined priority level is a higher 



priority level than the different priority level. 

In general, in another aspect, the invention is directed 
to configuring an LSP through an MPLS network. This aspect of 
the invention features determining if there is sufficient 
unused bandwidth on a network path to accommodate the LSP, and 
allocating the unused bandwidth of the network path to the LSP 
if there is sufficient unused bandwidth available. 
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This aspect of the invention may feature one or more of 
the following. A cost associated with using the unused 
bandwidth on the network path for the LSP is obtained and 
allocating includes using the unused bandwidth if the cost is 
5 below a predetermined maximum cost. The cost includes a 
number of hops associated with the network path between a 
source and a destination on the MPLS network. 

Determining if there is sufficient unused bandwidth 
includes successively checking plural other network paths to 

10 determine which one, if any, of the plural other network paths 
has sufficient unused bandwidth available to accommodate the 
LSP. The LSP has a predetermined priority level and 
allocating the unused bandwidth to the LSP takes into account 
the predetermined priority level of the LSP. Allocating the 

15 unused bandwidth includes taking at least a portion of the 

bandwidth in the network path that is being used by an LSP at 
a different priority level from the p redeter min ed priorit y 
leve l fo r use by the LSP at the predetermined priority level. 
The predetermined priority level is a higher priority level 

20 than the different priority level. 

Other features and advantages of the invention will 
become apparent from the following description and drawings. 
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DESCRIPTION OP THE DRAWINGS 



Fig. 1 is a block diagram of a network on which an 



embodiment of the invention is implemented. 



Fig. 2 is a block diagram showing MPLS labeling. 



5 



Fig. 3 is a flowchart showing a process for allocating 



bandwidth in the network of Fig. 1. 



DETAILED DESCRIPTION 



Referring to Fig. 1, a network 10 is shown. Network 10 
includes routers 11 to 15, source device 16, destination 
10 device 18, and MPLS domain 20. Typically, IP (Internet 

Protocol) is used to transfer data packets outside of MPLS 
domain 20, ^^though other suitable protocols may be u^sedT|^ The 
MPLS protocol is used to transfer data packets through MPLS 
domain 20. 



15 



The MPLS Protocol 



MPLS data flow resembles circuit switching. In this 



respect, MPLS is similar to the asynchronous transfer mode 



(ATM) protocol, i MPLS is frame-based, however, rather than 




20 



cell-based like ATM. MPLS encapsulates data packets of 



different protocols with a "label" that is routed through an 
MPLS network irrespective of the protocol of the data packet 



-5- 



Docket No.: 10360/06200^^^9TC 

that is encapsulated- Labels are switched at__ea_ch _f orwariiijijg 
hop between a source and destination on the MPLS network. 

A la^el is a number that uniquely identifies a set of 
data flows on^a particular link or within a particular logical 
5 link. Labels are of local significance only, meaning that the 
labels change as data packets follow an LSP (i.e., a data 
path) , hence the "switching" part of MPLS. MPLS can switch a 
frame from any type of transfer protocol, i.e., "layer 2" 
link, to any other kind of "layer 2" link without relying on 

10 any particular control protocol to perform the switching. 

Referring to Fig, 2, MPLS supports three different types 
of labels. On ATM link 21, MPLS uses the Virtual Circuit 
Identifier (VCI) label 22 and a Virtual Path Identifier (VPI) 
label 24. On frame relay links 23, MPLS uses a Data Link 

15 Connection Identifier (DLCI) label 26. other technologies, 

MPLS uses a, generic label called "Shim" 28, which is between 
layer 2 (30) and layer 3 (33) of protocol stack 34.5 



20 



In operation, an M PL S ~ c omp 1 i a n t router receives a label- 
encapsulated data packet on any of its interfaces, looks up 
the label in a^switching table; inserts a new label of the 
appropriate format, and sends the packet out of the 
appropriate router interface with the new label. Thus, an 
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MPLS-compliant router can switch a labeled packet from any 
interface to any other interface with a new label - 

As shown in Fig. 2, MPLS supports an arbitrary number of 
labels in a label stack 35, where the bottom-most label 
5 carries a specific bit identifying it as the bottom label of 
the stack. On Point-to-Point Protocol (PPP) links 40 or LAN_ 
media 38, "Shim" labels 28, 29 are used for all levels. 
Because MPLS can support a label stack regardless of how many 
jLabels are in the stack, it can support applications such as_ a^ 

10 virtual private . network (VPN) on a tunnel or stacked tunnels. 

An LSP is a predefined data path through an MPLS domain. 
An LSP is defined by an ingress point and an egress point of 
the MPLS domain, each of which contains an LER. A single MPLS 
domain may contain several LSPs. For example, MPLS domain 20 

15 may contain three LSPs, one of which is configured over 

routers/network path 12-13-14, another of which is configured 
over routers/network path 12-12c-13b-14a-14b-14 , and another 
of which is configured over routers/network path 12-12a-13a- 
14. A single network path may contain more than one LSP. For 

20 example, routers/network path 12-13-14 may contain several 
LSPs, even though only one is described here. The routers 
support bandwidth reservation, bandwidth prioritization, 
traffic engineering, traffic shaping, traffic policing. 
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tunneling, and QoS (Quality of Service) on various types of 
interfaces, on a path made up of any sequence of LSPs. 

There are two types of MPLS routers, which are defined by 
their functionality and placement in an MPLS network: Label 
Switching Routers (LSRs) and Label Edge Routers (LERs) . A 
router running MPLS at the edge of an MPLS domain 20 is an LER 
(routers 11 and 15) and those routers within an MPLS domain 
are LSRs. An LER places traffic on an LSP by performing a 
single routing operation. The next hop for the destination is 
the first label and link for the LSP. The routing operation 
can be simple or complex because it is performed only once at 
the head of the LSP. This means that any policy the LER uses 
to decide which traffic to put onto an LSP needs to be 
implemented only in the LER. The LSRs need not know the 
complex mapping of traffic that may be occurring at the edge 
of the MPLS domain and, therefore, require neither additional 
provisioning nor any additional hardware or software to 
support the LER' s requirements. 

MPLS uses a Forwarding Equivalence Class (EEC) , The EEC 
enables the MPLS protocol to map traffic to an LSP in a 
variety of ways. Two packets are considered to be in the same 



supports mappings based on arbitrary bit-length IP address 



EEC if they are to be routed along the same path. MPLS 
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prefixes or full 32-bit host IP addresses. More complex 
mappings are possible with explicitly routed control 
protocols, such as Constraint-based Routed Label Distribution 
Protocol (CR-LDP) and Extended Resource Reservation Protocol 
5 (RSVP) . This is because mappings are made^ocallyjwithin a 
router, switch, or other such device , and need^not be^ 
considered by other devices along the,_cpr>trol path. 

To establish an MPLS network, including LSPs, between two 
peers (network devices, such as^ LSRsT\ Label Distribution^ 
10 Protocol (LDP) and CR-LDP^are u„sed. These control protocols 
begin with a neighbor discovery phase based on a UDP (Uniform 
Datagram Protocol) "hellp/' . paqk^et^^. Once received, the peer 

LDP/CR-LDP protocol will respond with a UDP "hello" packet, at 

^ -^^ ■ ■'■ 

which point aV: TCP/IP communication channel is opened |between^ 

15 the two peers?! to handle a particular label space. : The two 
network devices then exchange initialization information, 
including the desired protocol version, operating modes, time-^ 
out values, label ranges, and types supported. 

Once both devices have agreed on a common subset ^of 

20 operating parameters, the label space is deemed usable and 

labels may be allocated. A continuous, low-frequency, "keep- 
alive" packet is sent over the TCP/IP (Transmission Control 
Protocol/Internet Protocol) connection to make sure that the 
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TCP/IP connection is still working in the absence of other 
control traffic. If too much time passes before a control 
message is received, the TCP/IP connection is terminated. 
Upon detecting a failure (either a time-out or layer-2 error) , 
LDP releases any allocated labels and sends appropriate 
messages to peer LSRs in the MPLS network so that the peer ^ 
LSRs can terminate their sessions. ^/"^ ^ 

/LDP deals primarily with duplicating destination-based 
trees that IP uses for forwarding purposes. <LDP transforms 
these trees into label-switching trees^^ (OSPF (Open Shortest 



Path First) and IS-IS (Intermediate System to Intermediate 
System) protocols compute and distribute a Shortest Path First 
(SPF) tree for a destination from a source. A topology 
database, from which the SPF tree is determined, is stored in 
15 an LER for the MPLS network (e.g., the LER closest to the 
source device) or it may be stored on LSRs in the network. 



/"^"he^ SPF tree, however determined, is copied by LDP, which 
allocates a label on a link to a given destination. This is 
repeated for every link in the SPF tree. 
20 In normal IP, each router along a path examines a 

packet's destination and chooses a new link. With LDP, the 
packet follows the same path it would with normal IP; however, 
the packet is assigned a flabell and (link when it is first 

-10- 



Docket No.: 10360/06200 



routed. When the packet arrives at its next hop, its label is 
substituted with the next label along the SPF tree toward the 
^^.v ^^U/destination. The LSR contains an^^IP forwarding tablg^^^^^ 

stores data specifying theTnext hop|and thei'next label ^ for the ^ 
5 packet. The data in the forwarding table Is-^keyed to the 



/ Packet's current label. The packet is then sent to the next 



hop, where label substitution continues until the destination 
jTUt-T reached. In this manner, the packet follows the same path 
^ it would with normal IP, but its IP header is not examined. 

10 In fact, any packet placed on the LSP would end up at the 
1 vA .destination, regardless of _it,s_ protocol, hence _the 

<^ "multiprotocol" part of MPLS. The protocol being encapsulated 
l^.^i^ be IP, although the addresses in the IP header may or may 

■r^, cxjb- not mean anything to the intermediate LSRs, since these 
i=y 15 addresses may be private. 

iij LDP can copy the SPF tree for a ^given destination in 

several ways. In its simplest form, LDP will allocate a label 



ICc^ fp^ every destination it can. rea£h, ^ ^en t el,l_ eve ry MPj^^ 

the destination and label_^ These messages are called^apping 
20^^^ messages^,; and every MPLS-capable router sends and receives 

^^^em._. Jhe MPLS router will eventually learn what labels reach 
which destinations and which labels it has given out to reach 
which destinations. To behave as an LSR, an MPLS router is 
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programmed to switc h^ bet ween the labels it has gi ven and the 
l abels it has received. 

! ^ ' " 

In this manner, IP forwarding tables in the router are 
turned into a label-switched set of trees. All of this can be 
accomplished using mapping messages. Such "blind" 
distribution of labels, however, may exhaust the label space, 
especially on hardware where label space is limited. This 
problem is addressed by "On De mand" modes, w hi ch allocate 
labels on de mand. That is, an MPLS router asks for a label 
when it wants one and gives out a label mapping when asked to 
do so (via a request message) . The most useful of these LDP 
modes, "Down-Stream-On-Demand" , does not allocate a label to a 
destination until requested to do so, and it will not re ply to 
t h a^ request un til„i.t_h a s^ne c ei_v_ed_a_l.a b^e.l_.f X-Qm„i J:.s_d o™ am 
peer^. These requests may merge with ^ a completed or p ending 
upstream req uest . In the "Down-Stream-On-Demand" mode, LDP 
^n on l^y follow the IP forwarding^ tables . T o_add r e.s.s, . jt h i.s 
shortcoming, an _extension_to LDP, CR-LDP, is used. With CR- 
^DP, a jrequest^XoxIj^^ d oes^ not^bji.^r^^ X^ll H^^^ft^ 

tree fo ^^ given ^ destin^ Instead, the reque st ^is told 

^tet"^foute to follow ^^^^ egbeddijg ^^^^ ^ 2^^^^— -^=''^^^ source 
route) in the requesjL- When the LDP/CR-LDP software receives 
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one of these requests, it does not use the IP forwarding table 



to rqute the req uest ,_as LJlP^w ojjld do. 



Referring to Fig. 3, a process 40 is shown for allocating 
bandwidth to configure LSPs over MPLS domain 20. Process 40 
provides a way to distribute LSPs over different network paths 
or "links" on an MPLS network. As used herein, a network path 
includes a string of routers, switches, or other packet 
forwarding devices in MPLS domain 20. Distributing LSPs over 
different network paths reduces packet congestion that can 
result if, e.g., too many LSPs are configured over the network 
path with the fewest number of hops. 

Process 40 runs on LER 11, since LER 11 is the closest 
LER to source device 16. Process 4 0 se lects ( 4_2), a network 
pat h through MPLS domain_j0 Jpj^ed e.g., on the number of hop s 
i n the network path . The number of hops is determined by 
reference to th e SPF tre^ derived from the topology database 
stored in memory 64 of LER 11. The network path with the 
least number of hops is typically selected first. In network 
10 of Fig, 1, the network path with the least number of hops 
includes LSRs 12-13-14. 



Allocating Bandwidth In An MPLS Network 
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Process 40 determines (44) if there is enough unused 
bandwidth available on the selected network path to 
^accommodate an LSP and its associated data packet flow, 

"Accommodate" here can refer to an y data-trans fer parameter ;. 



to bandwidth that is not currently being used to transfer data 
packets on the selected network path. 

Process 40 determines if there is enough available 
bandwidth on the selected network path by determining the 
total amount of available bandwidth on the selected network 
path and then determining the amount of bandwidth that is not 
currently in use. The amount of bandwidth on the selected 
network path and the amount of bandwidth not currently in use 
may be stored in LER 11 ^d/or it may be obtained by querying 
the individual LSRs^hat make up the network path, namely LSRs 
12-13-14. Process 40 compares the amount of bandwidth that is 
needed by the LSP to the amount of unused bandwidth available 
on the selected network path. In this way, process 40 
determines if there is sufficient bandwidth to accommodate the 
LSP and its associated data packets. 

If process 40 determines that ^the selecte d^ network pa th 
contains suffici ent bandwidth ^to accommo d ate the LSP (46),, 
process 4 0 obtains (48) the cost assgci.ated, with using the 




Unused" bandwidth refers 
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bandwidth from the selected network path. "Cost "^ in th is 
context, refers to th e number of hops on the selected network 
path. In this case, there are three hops, with each of 



routers 12, 13 and 14 constituting a hop. As noted above, the 
5 number of hops (i.e., the cost) is obtained by referencing the 
topology database maintained in LER 11. The network path is 
mapped in the topo logy djLtab^^s^e_£o--^determi^^ 
hops between source_and destinatio.n_dev-lces.^ 

Process 40 (^cides (50, 52, 54) whether to allocate 
10 bandwidth available in the selected network path to the LSP 

based on the Qaa£_ and on w he t.he -r_ t hex^e_._i.s,_.s.u f .f i c ig nt a va i.l ab 1 e 
bandwi dth to accommojdate^t^^ This includes comparing 

(50) the cost to a maximum acceptable cost. The maximum 
acceptable cost may be pre-programmed into LER 11 or it may be 
15 obtained from source device 16. 



If the cost is acceptable (52) , meaning that the cost is 
at or below the maximum acceptable cost, process 40 allocates 
(54) the unused/available bandwidth from the selected network 
path to the LSP. Allocation (54) is performed without 
20 substantially interfering with existing traffic on devices 

comprising the selected network path. The LSP is configured 
over MPLS domain 20 using the allocated bandwidth. 
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In process 40, if there is not enough bandwidth available 

^on ^he selected network path to accommodate the LSP (46) , 

process 40 returns to 42, provided that that there are other 

network paths in MPLS domain 20 (56) . Process 40 selects (42) 

another network path. For example, process 40 selects the jLucS^^^ 
_____ , ^ , — » (3-*.^^ 

network path in MPLS domain 20 that has the " next" least ^^f^f -^^^^.j 
number of hops. In this example, that network path includes \5^<s>K 



LS Rs 12- 12 a-13a- 14 . Process 40 repeats 44 to 46 foj: this 
newly-selected network path. If process 40 determines (46) 



that there is not enough bandwidth available on this newly- 
selected network path to accommodate the LSP, process 40 
returns to 42, where the next network path (i.e., the network 
path that includes routers 12-12c-13b-14a-14b-14 ) is selected. 
Process 40 is repeated, selectin g netw o^ patfajg^ons ecuti^^aj^ 
I^ased^^^ on^the^^^^ h£>gg ^n the ^ netwo rk paths, until an 

acceptable network path is found for the LSP or until it is 
determined that the cost is unacceptable. 

If the cost is determined to be unacceptable (52) or 
there is not enough available bandwidth on any network paths 
(46, 56) , the LSP may be configured in the network path^aving 
the most amount of unused bandwidth and/or the least amount of 
hops^Tl^It ^ay b e^jiec essar y, in this case, f or the LSP to take 
(60) bandw i dth^3 wau^ 
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path. This is especially true where the new LSP has a higher 

■ — ^ — " ' -> 

^rio rj^tj ^evel than LSPs that are alre ,a^Y_on that path^ 

In this regard, L SPs may be assigned a priori t- ^^ level 
based on the source device from which they originated. For 
example, LSPs may have priority levels of "0", "60", "90" and 
"100", with "0" being the lowest priority, "60" being the next 
highest priority, "90" being the next highest priority, and 
"100" being the highest priority. Pro cess 4 0 ma jy_J:a ke ■_i nto 
account the priority lev els of LSPs when taking bandwidth for 
the LSP from devices on a networ k path. 

Process 40 dete rmines the priority leveX^oX-,the LSP based 

— "- ^ r - -■ - ^ 

on sto red in f ormation_i.n _j:.h-e LSRs,ZLER_s_and/or by„_J:xan.smittina 
data p ackets through the LSPs _ (i . e . , signaling ) - Once the 
priority level has been determined, process 40 is executed in 
the manner described above. The difference here is that 
process 40 takes into account the priority level of the LSP 
when determining how to allocate bandwidth in a selected 
network path. That is, if process 40 needs to take (60) 
bandwidth away from an existing LSP, j^rocess 40 does so based 




on the level of priority of the new and existing LSPs 

So,^f the network path with the fewest number of hops is 
being used by an LSP with a low priority and the new LSP has a 
higher priority, process 40 takes bandwidth away from the old 
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LSP for use by the new LSP. I The data packets that were on the 
old LSP may be lost or queued for later transmission a nd a 
message may be sent to the corresponding source device 
indicating a termina tion and/or interruption of network 
services. The lower priority LSP may be torn down and is re- 
established by process 40 if it is to be used again. 

On the other hand, if the network path with the fewest 
number of hops is being used by an LSP that has a higher or 
equal priority than the new LSP, process 40 checks through the 
remaining network paths until it finds ^nough bandwidth, an 
acceptable cost, or LSPs that have a lower priority than the 
new LSpI? It is from th ese ne tj^^o^k_,p.ajthJ^^ bandwidth_ is^ 
taken, if available. If the new LSP has the lowest priority 
of any LSPs in current use on the network/^he new LSP will 
not be conf igured^~^d a message will be sent to the source 
device indicating that there are not sufficient network 
resources currently available to accommodate the new LSP. 

Process 40 may attempt to set up higher priority LSPs. 
When messages are sent to the LSRs in the MPLS network, it is 
possible that there is not sufficient bandwidth due to 
processing inaccuracies. In this case, a failure indication 
is sent and the search for a new network path continues, 
excluding any network paths that have failed. 
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Process 40 is implemented in LER 11 (Fig. 1) , which may 
be a (router, computer, or any other type of network device. 



LER 11 includes a memory 64 (see view 66) , which stores 
computer-executable instructions 68 to implement process 40, 
the MPLS and LDP protocols described above, OSPF, RIP, IS-IS, 
TCP/IP, and any other protocols necessary for communicating 
over network 10. Memory 64 also stores IP routing/forwarding 
tables and topology database 70. LER 11 also includes a 
processor 72, which executes instructions 68 to perform 
process 40. 

Process 40, however, is not limited to use with any 
particular hardware or software configuration; it may find 
applicability in any computing or processing environment. 
Process 4 0 ma ybe _imp 1 emen t e d .., in-Jia xdwa r e ( e -*-g ^jL._an ^ ASIC 
{Application-Specific Integrated Circuit} or programmable 
logic such as an FPGA {Field Programmable Gate Array}), 
software, or a combination of hardware and software. 

Process 4 0 may be implemented in one or more computer 
programs executing on programmable computers that each include 
a processor, a storage medium readable by the processor 
(including volatile and non-volatile memory and/or storage 
elements) , at least one input device, and one or more output 
devices. Program code may be applied to data entered using an 
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input device to perform process 40 and to generate output 
information. The output information may be applied to one or 
more output devices. 

Each such program may be implemented in a high level 
5 procedural or object-oriented programming language to 

communicate with a computer system. However, the programs can 
be implemented in assembly or machine language. The language 
may be a compiled or an interpreted language. 

Each computer program may be stored on a storage medium 

10 or device (e.g., CD-ROM, hard disk, or magnetic diskette) that 
is readable by a general or special purpose programmable 
computer for configuring and operating the computer when the 
storage medium or device is read by the computer to perform 
process 40. Process 40 may also be implemented as a computer- 

15 readable storage medium, configured with a computer program, 
where, upon execution, instructions in the computer program 
cause the computer to operate in accordance with process 40. 

Other embodiments not described herein are also within 
the scope of the following claims. For example, process 40 

20 can be used to allocate network resources other than 

bandwidth. Process 40 can select network paths in a random 
order instead of selecting network paths consecutively based 
on the number of hops contained in those paths. In this case. 
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a feedback path would be provided from 52 to 42 in Fig. 3, and 
the path from 52 to 60 would be eliminated. Process 40 can be 
used with protocols other than TCP/IP and those others 
mentioned above. Process 40 can be used with networks other 

5 than MPLS and is not limited to networks that route data 
packets using an encapsulation or other labeling scheme. 

It is to be understood that while the invention has been 
described in conjunction with the detailed description 
thereof, the foregoing description is intended to illustrate 

10 and not limit the scope of the invention. Aspects, advantages 
and modifications not described herein are also within the 
scope of the following claims. 



-21- 

i 



